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Abstract 

If an absolute reference frame with respect to time, position, or 
orientation is missing one can only implement quantum operations 
which are covariant with respect to the corresponding unitary sym- 
metry group G. Extending observations of Vaccaro et al., I argue that 
the free energy of a quantum system with G-invariant Hamiltonian 
then splits up into the Holevo information of the orbit of the state 
under the action of G and the free energy of its orbit average. These 
two kinds of free energy cannot be converted into each other. The first 
component is subadditive and the second superadditive; in the limit 
of infinitely many copies only the usual free energy matters. 

Refined splittings of free energy into more than two independent 
(non-increasing) terms can be defined by averaging over probability 
measures on G that differ from the Haar measure. 

Even in the presence of a reference frame, these results provide 
lower bounds on the amount of free energy that is lost after applying 
a covariant channel. If the channel properly decreases one of these 
quantities, it decreases the free energy necessarily at least by the same 
amount, since it is unable to convert the different forms of free energies 
into each other. 
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1 Introduction 



Free energy is among the most important concepts of thermodynamics since 
it formahzes the fact that the usabihty of energy resources depends also on 
their entropy. Roughly speaking, the idea is that in an energy conversion 
process the target system should typically be provided with energy with- 
out transferring entropy (like increasing the kinetic of potential energy or a 
macroscopic body, for instance). Therefore, the worth of a system for being 
an energy source depends on the question to what extent one can extract 
energy from it without releasing too much entropy S since the transfer of 
the dispensable entropy to the environment requires the additional amount 
SksT of energy (here ksis Boltzmann's constant and T is the temperature of 
the heat reservoir where the entropy is transferred to, e.g., the environment). 
Hence the amount of work that can be extracted from a physical system is 
not given by its inner energy. Instead, it depends also on the entropy and on 
a fixed reference temperature, namely the temperature of the environment 
which is potentially used as an entropy sink. Conversely, a system that has 
no inner energy at all (like a degenerate two-level system) can be used to 
extract energy from the environment if its physical state is not the maximal 
entropy state. In other words, information can directly be used to extract 
work from the surrounding heat bath [1, 2, 3]. This fact implies on the other 
hand that the initialization of bits requires energy resources, an observation 
which is usually referred to as Landauer's principle (cp. [4, 5]). All these 
statements can be brought into a consistent picture by the notion of free 
energy: for instance, the initialization of a non-degenerate two-level system 
to a well defined pure state increases its free energy and requires therefore 
resources of free energy. 

For a quantum system with density operators p and Hamiltonian H one 
can define (in analogy to the classical definition, see [6]) the free energy by 
the difference 



tr{pH) 



S{p) ksT , 



(1) 



where 



S{p): 



tr(pln p) 
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is the von-Neumann entropy 



^ of p. Since the Gibbs state 



(2) 



It := 



) 



tr 



minimizes (1) it is convenient to redefine free energy by 



F{p) := tripH) Sip) knT - tri^rH) + ksT , 



(3) 



implying that F{p) = if and only if p = 77-. 

It is known that no physical process which uses no additional energy re- 
sources can convert p into a state p with F{p) > F{p). This follows already 
from the fact that F{p) is up to the constant ksT the KuUback-Leibler dis- 
tance between p and 7 [8] and that it is not possible to create non-equilibrium 
states from 7 without using additional energy resources. Therefore 7 is in- 
variant with respect to all those operations and to increase F would mean to 
increase the distance to 7 in contradiction to the fact that no operation can 
increase KuUback-Leibler distances between density operators [8]. 

Even though the monotonicity of free energy is maybe the most important 
constraint on the possible operations one should not forget that additional 
constraints arise in particular for quantum systems. However, they depend 
on additional assumptions on the set of physical processes. Refs. [3, 2, 9, 10] 
consider work extraction from quantum systems by unitary operations. In 
these models, the amount of extractable work does not only depend on the 
inner energy and the entropy of the system. Instead, it can only be calculated 
from more detailed information on the spectrum of the density operator. 

In [11] we have furthermore considered timing information as a kind of 
thermodynamic resource. The idea was the following. Defining a physical 
system that includes all available clocks, no operation on the joint system can 
increase the information about an externally defined time reference frame. 
Every quantum state that is prepared in a superposition of different energy 
eigenstates with well-defined phase with respect to the external reference 
frame, provides some information on the latter. The impossibility to create 

^Note that it is not straightforward to replace the classical quantity S with von- 
Neumann entropy in quantum mechanics [7]. However, it goes beyond the scope of this 
article to discuss this issue. We assume here that the free energy in eq. (1) is nevertheless 
a reasonable quantity for quantum thermodynamics. 
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information on the external time can also be interpreted as the impossibility 
to prepare superpositions of different energy eigenstates with well-defined 
phase. Such kind of coherent superpositions are therefore a special kind of 
deviation from equilibrium which could be considered as a resource in its 
own right. Whereas the complexity for communicating reference frames for 
time, position, and orientation has been extensively studied in the literature 
(e.g. [12, 13]) and its cryptographic power has been pointed out [14], the 
thermodynamical relevance of reference frames has mainly be considered in 
[15] and [16]. Whereas the first article considers the thermodynamic cost 
of establishing reference frames with classical communication, the authors in 
[16] observe that the worth of thermodynamic resources is reduced by missing 
reference frames. The latter observation is the venue of this article. 

The paper is organized as follows. In Section 2 we sketch the idea to 
restrict the set of operations to covariant maps, i.e., those that can be im- 
plemented without refering to an external frame. We rephrase the idea of 
Vaccaro et al. [16] to consider a thermodynamic theory that is modified by 
the additional constraint of covariance. 

In Section 3 we will show explicitly that the covariance condition implies 
a splitting of free energy into two terms which cannot be converted into each 
other. We refine this splitting of free energy into arbitrarily many terms 
reflecting the fact that different kind of timing information that refer to 
different time scales cannot be converted into each other. The theory can be 
generalized to other covariance conditions that may stem, for instance, from 
missing spatial or rotational reference frames provided that the considered 
unitary symmetry operation commutes with the Hamiltonian. In Section 4 
we argue why the splitting loses its relevance in the macroscopic limit of a 
large number of identical systems. In Section 5 we will show that the results 
have implications also for situations where reference frames are available. 
This is because every covariant operation that decreases one kind of free 
energy decreases also the total amount of free energy and this loss is clearly 
irreversible even if a reference frame is available. We sketch how to apply this 
idea to time-invariant passive devices (i.e. devices without energy source) in 
optics or in electrical engineering. Then our results imply that a device that 
causes an indeterministic time delay of the output signal causes necessarily 
a loss of free energy. 
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2 Covariant operations 



The set of possible operations on a quantum system is given by the set 
of completely positive trace-preserving maps [17]. In [11] we have argued 
that not every CP map C can be implemented if no time reference frame is 
available. Consider a quantum system with free evolution 

Assume that the state p was prepared at time t = 0. If a person imple- 
ments an operation C at time instant s the state of the system after C was 
implemented is described by 

C{a,{p)). 

Looking at the system later it is described by the state 

at_,(c(a,(p))), (4) 

if t is the time that has passed since the system was prepared. If no clock was 
available during the implementation of C, it is implemented at a random time 
instant s. We may therefore define a CP map C that results from averaging 
(4) over all < s < t. If the quantum system has discrete spectrum and t is 
large compared to the time scale given by the inverse of the minimal distance 
between its energy eigenvalues, C satisfies approximatively the covariance 
condition 

atoC oat, Vi. (5) 

In [11] we have therefore assumed that the set of operations which can be 
performed without additional clock is given by those that satisfy the above 
covariance condition (5). In [18] we have analyzed this class of CP maps in 
full detail. 

With the same arguments one can restrict the set of available operations 
to those satisfying covariance conditions with respect to other symmetry 
groups if the corresponding reference frame is not available^. Interesting in- 
stances are given by the group of space translations or by the rotation sym- 
metry [16]. The symmetry is represented by a unitary group Ug, g & G acting 

^For a model for a formulation of quantum mechanics that avoids absolute reference 
frames see [19]. 
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on the Hilbert space of the considered system. We assume that [f/^, H] = 0, 
otherwise {Ug) would not be a symmetry group of the Hamiltonian and the 
missing reference frame would even make the definition of H impossible. Ev- 
ery transformation is covariant with respect to G, i.e., we can only implement 
a CP map C with 

C{UgpUl) = UgCipWl . (6) 

It has already been observed in Ref. [16] that the absence of a reference 
frame puts thermodynamically relevant constraints on the set of available 
operations. The idea is that the system may contain some information that 
is not accessible without using the frame. The authors assume that the work 
extractable from a d-dimensional system being in the mixed state p is usually 
(if a reference frame is available) given by 

kBT(^\nd-Sip)y (7) 

Note that this definition of extractable work refers actually to thermody- 
namics in degenerate systems or the infinite temperature limit, where the 
Hamiltonian of the system is irrelevant and the free energy F{p) is given 
by the difference of the entropy to the maximally mixed state. Within this 
thermodynamic perspective [20] all maximally mixed states are free resources 
whereas usual (finite temperature and non-degenerate) thermodynamics as- 
sumes all Gibbs states to be free and "worthless" resources. To consider F as 
defined in Eq. (3) as the extractable work is therefore a bit more general. We 
will refer to these two points of view as the finite and the infinite temperature 
picture, respectively. 

If no reference frame is available, the extractable work reduces to 

WG:^kBT(^lnd- S{p)^ (8) 

instead of (7) (as the authors of [16] observe), where 

p:= [ UgpUldp{g) 
Jg 

is the average of p over the orbit of G, where we have implicitly assumed for 
the moment that G is a compact group and denoted its Haar measure by p. 
Introducing the reference information by 

R{p) := S{p) - S{p) , 
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the deficit between the terms (7) and (8) is R{p) ksT, a term called asym- 
metry in [16]. The asymmetry is non- increasing under covariant operations 
since no trace- preserving CP map can increase the Holevo information^. The 
authors of Ref. [16] prove that even covariant operations that include mea- 
surements cannot increase the average asymmetry as long as the probabilities 
for the measurement outcomes arc G-invariant. They consider a family Cj 
of maps where each Cj is a covariant CP map^ and show that the average 
asymmetry of the conditional post measurement states pj := Cj{p)/pj with 
Pj := tr{Cj{p)) cannot exceed the initial asymmetry. However, this gen- 
eralization needs not explicitly be made when we include a toy version of a 
measurement apparatus into the description. One can check that there exists 
a covariant map C that transfers the state 

|0)(0|®p (9) 

of the "measurement apparatus" plus system into 

J2\^){j\®C,{p), (10) 
j 

where the state \j) indicates that j was measured. Assuming that the group 
acts trivially on the ancilla system, the asymmetry of the state (10) coin- 
cides with the average asymmetry of the ensemble Pj,pj- Since we know 
that C cannot increase the asymmetry of (9), the average post-measurement 
asymmetry cannot be increased either. 

In the following section we will show that the observations of [16] can be 
generalized to the finite temperature setting and give rise to two kinds of free 
energy. 

3 Decomposition of free energy 

The key statement of this section is that the different components in which 
we decompose the free energy are independent resources in the sense that no 

^This follows, for instance, if one rewrites Holevo information as the mutual informa- 
tion of the bipartite state J2jPj\j){j\ ^ Pj- Then the statement follows because no local 
operation on one system can increase the mutual information [21] of the joint system. 

''Note that this class of operations docs not include general covariant measurements 
where the outcome probabilities change according to the group action. 
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covariant channel can increase them without access to an additional energy 
resource. To state this formally, we will use the notion of a passive channel: 

Definition 1 A trace-preserving CP map C acting on a quantum system 
with Hamiltonian H is called passive if C{jt) = It with the thermal state 
7^ as defined in eq. (2). 

We have already seen that passivity implies F(C{p)) < F{p). To define 
our decomposition of free energy, we assume for the moment that the con- 
sidered quantum system has discrete energy spectrum such that the time 
average p exists. It is then given by 

3 

where (Pj) is the family of energy eigenprojections. We write the free energy 
F{p) as 

F{p) = F{p) - P(p) + F{p) , 

and use the fact that averaging over the time can only decrease the free 
energy since the energy term in (3) remains the same. Then we have 

F{p) - F{p) = {s{-p) - S{p)) UbT ^RksT, 

and conclude 

F{p) = R{p) kuT + F{-p) 

where we call P(p) the covariant free energy. Note that P(p) can be con- 
sidered as the natural generalization of the accessible work Wq in eq. (8) to 
our finite temperature setting. To see that P(p) is non-increasing when ap- 
plying passive channels we observe that a covariant channel C that converts 
a state p to another state a must necessarily convert p to a. The channel 
C is therefore only passive if P(p) > F(^). This shows that asymmetry as 
well as covariant free energy are both non-increasing under passive covariant 
operations. We rephrase these observations as a theorem: 

Theorem 1 The free energy of a quantum system with discrete energy levels 
can he decomposed into 

F{p) = R{p) kBT + Fip), 
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where 

Rip) := S{p) S{p) 

is the Holevo information of the time orbit and F{p) is the free energy of 
the orbit average. The terms R{p) and F{p) are both non-negative and non- 
increasing with respect to time-covariant passive operations. 

Theorem 1 can be generalized in two respects. First, we may have an 
arbitrary group representation instead of the time evolution provided that 
it leaves the Hamiltonian invariant. Then the term tr{pH) is preserved by 
averaging, too. Second, we need not necessarily consider uniform averaging 
over the whole group. Instead, we can define hierarchies of states, obtained by 
averaging more and more over the group, and calculate free energy differences 
between more and less mixed states. By this procedure, we obtain a splitting 
of free energy into many independent terms. We phrase this idea also as a 
theorem: 

Theorem 2 Given a quantum system with Hilbert space Ti and Hamiltonian 
H . Let g ^ Ug with g E G be the unitary representation of a group G acting 
on Ti. such that [Ug,H] — 0. Let /ii, /i2, ■ ■ ■ , /^n be an n-tuple of probability 
measures on G such that there exist measures Vj on G with /ij * Vj = pj+i, 
i.e., pjj^i is the convolution^ of /ij with a third measure Uj. Let /ii be the 
Dirac measure on the identity. 

Let be the CP map given by the average 

Mp) I UgpUldpig) . 

JG 

Then the free energy F{p) splits up into the n terms 

n 

F{p)^Y.^M^ 

with 

^The convolution product /i * of measures /x, on G is here defined by the probabihty 
distribution of h o g\l g and h G G are independently distributed according to fx and 
v, respectively (see [22], and adapt Def. 19.8 to our setting). 
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and 

F„(p) := F{A,„{p)) . 

All terms Fj{p) for j = 1, . . . ,n are non-negative and non-increasing with 
respect to passive covariant operations. 

Proof: Fn{p) is clearly non- negative. To see that it is non- increasing we 
observe 

f[a,sc{p)))=f{c{a,M))<f{a,Sp)). 

where the last inequality is due to the monotonicity of usual free energy 
under passive operations. The terms Fj{p) for 1 < j < n — 1 are, up to the 
constant /c^T, given by the entropy difference 

s{a^,{p,))-S{p,), (11) 

with 

This follows easily from A^j_^y = A^ o A^. Expression (11) is for fixed j 
the Holevo information [17] of the ensemble defined by the family of states 
UgPjU^ with g & G according to the probability measure uj. It is therefore 
non-negative. To show that it is non-increasing when applying C we observe 
that the covariance implies 

A,^{C{p)) = C{p,) , 

and Fj{C{p)) is therefore, up to the constant /c^T, the Holevo information 
of the ensemble 

UgC{p,)Ul = C{Ugp,Ul), geG 

according to the probability measure uj. Then monotonicity of Fj{p) with 
respect to C follows from the monotonicity of Holevo information. □ 

The advantage of Theorem 2 compared to the preceding remarks is not 
only that it allows a splitting into more than two terms. It is furthermore 
important that it allows a splitting for non-compact groups since it does not 
refer to a uniform average over the whole group. 
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4 Superadditive and subadditive components 



We will now restrict our attention again to the splitting into two free energy 
terms like in the beginning of Section 3 and investigate how these quantities 
behave when systems are composed to joint systems. Let us consider a two- 
level system with lower and upper state, denoted by |0) and |1), respectively. 
Let E denote the energy gap between both levels. If ksT > E its equilibrium 
state is almost the maximally mixed state 7oo := I2/2. The free energy of 
the state 

l+> :=^(|0) + |1)) 

is given by 

One checks easily that i^(7oo) is negligible compared to the first term since 
E <^ ksT and the entropy difference between 7^0 and 7^ is small. 

To see the asymptotics of many copies of |+)(+| we observe that the 
entropy of the time average of 1+) (-|-|®" is exactly the entropy of the binomial 
distribution i^„,i/2 with 

Hence the entropy of the average of |+)(+|®" increases only with O(lnn) 
since the measure is supported by only n different points. In other words, 
there are only n different eigenspaces of the joint Hamiltonian 

H^EJ24'\ 
3 

where is the Pauli matrix a-^ acting on qubit j. For the same reasons, 
the covariant free energy of |+) (+|'^"- can be bounded from below by n In 2 — 
O(lnn). Hence the asymmetry part of the free energy is for large n more and 
more a negligible fraction of the total free energy. Similar arguments apply 
to the general situation. 

This does not mean, however, that the splitting is completely irrelevant 
for large particle numbers. Instead, the results show that every process that 
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increases the covariant free energy of some of the particles requires interac- 
tions between them. Hence the amount of increase of covariant free energy 
can bound the number of interacting particles from below. Therefore the 
results imply statements on the complexity of the considered process. This 
kind of complexity issues are related to the questions discussed in [23] where 
we have discussed the complexity of molecular heat engines. The key ob- 
servation was that the additional constraints for energy conversion processes 
that arise in simple quantum systems imply statements on the complexity of 
energy conversion processes in macroscopic ensembles of particles. 

For the sake of completeness we sketch the proof of the superadditivity of 
covariant free energy. Then the subadditivity of the asymmetry term follows 
because total free energy is additive. The essential observation is that for 
two states p and a with time evolution at and Pt, respectively, the entropy 
of the joint time average p<^ a cannot be greater than the entropy of the 
tensor product of the averages, i.e., p (S> o". This is because the latter state 
can be obtained from the former by averaging over all possible relative time 
translations at ® P-t- We have therefore 

F(^Wa) > F{p (8) a) = F{p) + F{a) . 

5 Applications 

Remarkably, the results above have also implications for situations where 
a reference frame is available since every passive covariant operation that 
decreases one term Fj(p) necessarily decreases the total free energy since it 
is unable to convert one kind of free energy into the other. This can be used 
to derive lower bounds on the loss of free energy of a physical signal like an 
electrical pulse or a light pulse when it passes a device such that it degrades 
the time accuracy of the pulse. We will explain this idea using a system with 
discrete energy levels as a toy model for the physical signal. 

Consider for instance a system which has some integer vahies ni,n2, ■ ■ ■ .rid 
as energy spectrum. Due to the periodicity, we can restrict its group of time 
translations to G := SU{1). Parameterizing G by the interval [0, 27r] we 
obtain the unitary representation 

t^Ut-.^ diag{e-''''\ 6"^*"% . . . , e"^*"'') . 
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Now we consider an input state p which is perfectly distinguishable from its 
time evolved state as{p) for some s G M in the sense that 

tr{pas{p)) =0. 

Let C be a passive time covariant operation that corrupts the timing infor- 
mation of p in the sense that the corresponding output density matrices C{p) 
and C{as{p)) = as{C{p)) are not perfectly distinguishable. Then we can use 
the results of Section 3 to bound the free energy loss of the channel from 
below as follows. Define a measure on SU{1) by 

where Sq and 6s denote the Dirac measures at the time instants t = and 
t = s, respectively. By applying Theorem 2 using the measures pi := 6o and 
P2 '■= 1^1 the free energy of the input splits up into 

F{p) = ksT {s{A,{p)) - S{p)) + F{A^{p)) = ksT ln2 + F{A^{p)) , 

and for the output into 

F{C{p)) = ksT (^S{A,{C{p))) - S{Cip))) + f[a,{C{p))) . 

The fact that the output states are not perfectly distinguishable is equivalent 
to the statement that the Holevo information of an ensemble that consists of 
the states C{p) and C{as{p)) with probabihty 1/2 each is strictly less than 
In 2, i.e., c := S{A^{C{p))) - S{C{p)) < In 2. Then the loss of free energy 
satisfies 

F{p)-F{C{p))>{ln2-c) ksT. 

The intuitive content of this statement is that it provides lower bounds on 
the free energy loss caused by devices that corrupt the time accuracy of the 
input signal by generating output signals with stochastic time delay. 

To consider a more concrete physical situation, assume some electrical, 
acoustical, or optical signal enters a passive device whose input-output be- 
havior is described by the time covariant map C. The time covariance reflects 
only the fact that the state of the physical device is stationary before the 
signal enters into it (see [18] for details). Assume that the channel converts 
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Figure 1: Symbolic drawing of input and output signals. The curves do not 
necessarily have direct physical meaning. Their widths only symbolize the time 
scale of distinguishability. The curves could, however, have a direct meaning in 
the following situation. Consider a pulse which has on the considered time scale 
a well-defined time of arrival (since the quantum uncertainty [24] may be only 
relevant on a much smaller scale). Assume that the time of arrival is subjected to 
stochastic fluctuations such that the curves indicate the probability distribution 
of the time of arrival. Then an increase of these fluctuations leads necessarily to a 
loss of free energy according to our results. 

some input signal that can be perfectly distinguished from its time evolved 
copy that is defined by a time shift At in the sense that the quantum states 
p and a/\t{p) are mutually orthogonal density operators. Assume that the 
channel generates an unknown time delay such that the output density op- 
erators C{p) and C{a/^t{p)) are not perfectly distinguishable. 

Then the fluctuation of the time delay leads necessarily to a loss of free 
energy. One may argue that these fluctuations would obviously lead to a loss 
of free energy of the signal since they increase the entropy of the state. How- 
ever, a priori it is not clear whether the channel could change the probability 
distribution of energy values such that the loss of free energy caused by an 
increase of entropy is compensated by an increase of the inner energy tr{pH). 
The statement that no covariant channel can do such a compensation is the 
key statement of this article. 

The signal above is assumed to pass the device only once. By applying 
our results to such a situation with aperiodic dynamics we have actually 
ignored the fact that it refers necessarily to continuous spectrum. Otherwise 
the free evolution of the signal would be quasiperiodic. We may remove this 
by letting it oscillate between distant mirrors for obtaining discrete energy 
spectrum. The problem with the aperiodic limit is anyway that it refers to an 
infinite amount of free energy. This can be seen as follows. Given a density 
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operator p such that for some t G M all states ant{p) for n G Z are perfectly 
distinguishable from p. Then one can choose an arbitrary probability measure 
on Z by (pj) with '^jPj = 1 and observe 

F{p) - Fl^Y.P^atj{p)) = knTSip) , 
j 

where S{p) denotes the Shannon entropy of p. By choosing measures p with 
diverging entropy one can show that the free and recalling that F is always 
non-negative, the statement follows. However, even though the free energy 
diverges in the aperiodic limit our statement on the free energy loss still 
makes sense since the absolute value of the free energy is irrelevant in this 
context. 

This work was funded by the Landesstiftung Baden-Wiirttemberg, project 
AZl. 1422.01. 
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